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Claims: 

1 . A method for performing surveillance comprising: 

monitoring an indicia of manual imaging sensor control; 

switching to automatic imaging sensor control when said indicia indicates that 
manual imaging sensor control is not being used and switching to manual imaging 
sensor control when said indicia indicates that manual imaging sensor control is being 
used; 

determining imaging sensor coordinates for at least one imaging sensor; 
mapping the imaging sensor coordinates to image pixel coordinates; and 
processing the image pixel coordinates to determine information regarding 
objects within a scene that is captured by the at least one imaging sensor. 

2. The method of claim 1 wherein the manual imaging sensor control comprises 
manipulating a joystick to control an orientation of an imaging sensor and said indicia 
comprises movement of the joystick. 

3. The method of claim 1 wherein the orientation of the imaging sensor comprises 
pan, tilt, and zoom. 

4. The method of claim 1 further comprises detecting object motion within the scene. 

5. The method of claim 4 wherein, upon detecting object motion during automatic 
imaging sensor control, switching to manual imaging sensor control. 

6. A method of performing surveillance comprising: 

pointing an imaging sensor at a location in a scene; 
detecting a moving object within the scene; and 

controlling pan, tilt and zoom functions of the imaging sensor to automatically 
track the moving object. 

7. The method of claim 6 wherein the pointing step further comprises: 

manually directing the imaging sensor to image the location. 
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8. The method of claim 6 wherein the pointing step further comprises automatically 
scanning the imaging sensor across the scene to image the location; and continue 
scanning the scene until the moving object is detected. 

9. The method of claim 6 further comprising deriving a latitude, longitude and altitude 
of the moving object based upon the pan, tilt and zoom parameters of the imaging 
sensor. 

10. The method of claim 6 further comprising: 

predicting a sight line between the imaging sensor and the moving object; and 
using the sight line to optimally image the moving object. 

1 1 . The method of claim 1 0 further comprising a plurality of imaging sensors and using 
the sight line to select an imaging sensor from the plurality of imaging sensors that 
provides an optimal view of the moving object. 

12. The method of claim 6 wherein the location is a region of the scene that is imaged 
by the imaging sensor, and further comprising establishing a sensitivity level for 
processing information within the region. 

13. The method of claim 12 wherein the sensitivity level establishes a motion detection 
sensitivity level. 

14. The method of claim 6 wherein the information produced by the imaging sensor is 
displayed in combination with a zone map that depicts the scene. 

1 5. The method of claim 1 4 wherein coordinates of locations in the zone map are 
mapped to pan/tilt/zoom parameters using a look-up table. 

16. The method of claim 14 further comprising combining information from a plurality 
of imaging sensors with the zone map. 

17. The method of claim 9 wherein a plurality of imaging sensors image the scene and 
the latitude, longitude and altitude of the moving object are used to handoff imaging of 
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one imaging sensor to another imaging sensor. 

18. A surveillance system comprising: 

an imaging sensor control module for pointing an imaging sensor at a location in 
a scene; 

an image processor for detecting a moving object within the scene; and 
a controller for controlling pan, tilt and zoom functions of the imaging sensor to 
automatically track the moving object. 

19. The surveillance system of claim 18 wherein the image processor derives a 
latitude, longitude and altitude of the moving object based upon pan, tilt and zoom 
parameters of the imaging sensor. 

20. The surveillance system of claim 18 wherein the image processor predicts a sight 
line between the imaging sensor and the moving object and uses the sight line to 
enable the imaging sensor control module to point the imagines sensor to optimally 
image the moving object. 

21. The surveillance system of claim 20 further comprising a plurality of imaging 
sensors and using the sight line to select an imaging sensor from the plurality of 
imaging sensors that provides an optimal view of the moving object. 

22. The surveillance system of claim 1 8 wherein the location is a region of the scene 
that is imaged by the imaging sensor, and the image processor establishes a sensitivity 
level for processing information within the region. 

23. The surveillance system of claim 22 wherein the sensitivity level establishes a 
motion detection sensitivity level. 

24. The surveillance system of claim 1 8 wherein the information produced by the 
imaging sensor is displayed in combination with a zone map that depicts the scene. 

25. The surveillance system of claim 24 wherein coordinates of locations in the zone 
map are mapped to pan/tilt/zoom parameters using a look-up table. 
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26. The surveillance system of claim 24 further comprising combining information from 
a plurality of imaging sensors with the zone map. 



27. The surveillance system of claim 1 8 wherein a plurality of imaging sensors image 
the scene and the latitude, longitude and altitude of the moving object are used to 
handoff imaging of one imaging sensor to another imaging sensor. 



